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PROFICIENT VS. PREPARED: 

DISPARITIES BETWEEN STATE TESTS AND THE 2013 NATIONAL 
ASSESSMENT OF EDUCATIONAL PROGRESS (NAEP) 


Achieve 


Today's economy demands that all young people 
develop high-level literacy, quantitative reasoning, 
problem solving, communication, and collaboration 
skills, all grounded in a rigorous and content-rich 
K-1 2 curriculum. Acquiring these skills ensures that 
high school graduates are academically prepared to 
pursue the future of their choosing. 

Many state tests, however, continue to mislead 
the public about whether students are proficient. 
Parents, students, and teachers deserve 
transparency and accuracy in public reporting. 


Frequently, states' testing and reporting processes yield significantly different results than the data 
collected and reported by the National Assessment of Educational Progress (NAEP). While NAEP, the 
Nation's Report Card, scores are the gold standard for measuring student achievement and serve as a 
yardstick for state comparisons, NAEP results are generally not known by students and their families 
who rely on their state test results to know how they are performing. While no single test can show 
everything we need to know about how a student is performing in school, test scores along with 
information about a student's work in the classroom give families the information they need to know 
about a student's progress. 


Findings 

• Over half of states'discrepancies in state vs. 2013 NAEP results are more than 30 percentage 
points. 

• Too many states are saying students are "proficient" when they are not actually well prepared. 

• A number of states have been working to address proficiency gaps; this year, even more will 
do so by administering the college- and career-ready-aligned Smarter Balanced and PARCC 
assessments. 


What is proficiency? 

NAEP defines proficiency as"solid academic performance" for each grade assessed. Students 
reaching this level have demonstrated competency over challenging subject matter, including 
subject-matter knowledge, application of such knowledge to real-world situations, and analytical 
skills approximate to the subject matter." (http://nces.ed.gov/nationsreportcard/achievement.aspx) 
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State test results and the 
National Assessment 
of Educational Progress 
often tell conflicting 
stories about students' 
proficiencies in math and 
reading. 
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Fourth grade reading results and 8th grade math results are highlighted in this report; it is 
essential to learn to read by 4th grade to be able to read to learn moving forward, and 8th grade 
math proficiency indicates that a student is prepared for higher-level math in high school. 


Fourth Grade Reading 
Top Truth-Tellers 

The following states reported 2013-14 state 
proficiency levels closest to their state's 
2013 NAEP proficiency levels (differing by 15 
percentage points or fewer): 

New York 

Wisconsin 

Utah 

Alabama 

Massachusetts 

Missouri 

Minnesota 

Tennessee 


Biggest Gaps 

The following states have the largest gaps 
(more than 40 percentage points) between 
their reported 2013-14 state proficiency 
levels and their state's 2013 NAEP proficiency 
levels: 

Georgia 

Louisiana 

Alaska 

Arkansas 

South Carolina 

Ohio 

Indiana 

Arizona 

Texas 

Hawaii 

Nevada 

North Dakota 

Nebraska 

Maryland 


What's Next? 

201 5 NAEP results will be released this fall, 
presenting new opportunities to understand 
student proficiency and state reporting. 


Eighth Grade Math 

Top Truth-Tellers 

The following states reported 2013-14 state 
proficiency levels closest to their state's 
2013 NAEP proficiency levels (differing by 15 
percentage points or fewer): 

New York 

Massachusetts 

Utah 

Michigan 

North Carolina 

Wisconsin 

Nevada 

Alabama 

Colorado 

Minnesota 

Wyoming 

Washington 

Kentucky 

West Virginia 


Biggest Gaps 

The following states have the largest gaps 
(35 percentage points or more) between 
their reported 2013-14 state proficiency 
levels and their state's 201 3 NAEP 
proficiency levels: 

Georgia 

Texas 

District of Columbia 

Mississippi 

Louisiana 

Indiana 

Ohio 

Iowa 

South Carolina 
Arkansas 
Delaware 
Alaska 
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Proficient vs. Prepared 

4th Grade Reading, 2013-14 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Differential 

Georgia -60 

Louisiana ^ -53 
Alaska 1 “ -51 

Arkansas -51 

South Carolina -49 

Ohio -49 

Indiana -48 

Arizona -48 

Texas ^ -46 
Hawaii ■ -42 

Nevada -42 

North Dakota -41 

Nebraska ^^^^MBBBBBBBBBBBBBBB^^^^^^^^^^^^^^^^^^^^^^™ -41 

Maryland -41 

Michigan ^ -39 
Oregon -39 

Iowa ' -37 

Mississippi -36 

Delaware -35 

Oklahoma -35 

Rhode Island -32 

Washington -30 

New Hampshire -30 

Maine -29 

Pennsylvania -28 

nia ^ 

District of Columbia -27 

Wyoming -27 

Colorado -26 

New Mexico -23 

Illinois -23 

Florida -22 

North Carolina -21 

Kentucky ^^^^^BBBBBiHB^^^^^ -18 

New Jersey -lg 

West Virginia -16 

Tennessee -15 

Minnesota -14 

Missouri -H 

Massachusetts BBBBHBHHBBBH^"^ -7 

Alabama -7 

Utah IBBBBBI^BBBr^ 

Wisconsin 

New York |^Bii^^^^HB_ 


0 10 20 30 40 50 60 70 80 90 100 


B % Reported proficient or above by state test a % Reported proficient or above by NAEP 
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Proficient vs. Prepared 

8th Grade Math, 2013-14 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 

Differential 


Georgia _ 53 

Texas 1 -48 

District of Columbia _46 

Mississippi ^ -46 
Louisiana _43 

Indiana 1 1 -43 

Ohio -40 

Iowa -39 

South Carolina .39 

Arkansas -36 

Delaware .35 

Alaska -35 

Pennsylvania , 3 j 

Nebraska ^ -30 
Oklahoma -29 

Virginia -29 

Arizona _28 

Oregon 1 1 -28 

Hawaii 1 -28 

North Dakota -25 

Illinois 1 -24 

New Jersey -23 

Maryland -22 

Rhode Island -21 

Missouri ^ “ ™““ ““■™~ -20 

Tennessee -19 

New Mexico -17 

New Hampshire -17 

Maine -16 

Florida -16 

West Virginia -15 

Kentucky -15 

Washington -14 

Wyoming -12 

Minnesota -H 

Colorado 1 -10 

Alabama -9 

Nevada -9 

Wisconsin 

North Carolina -6 

Michigan -5 

Utah MBBHHHBBHBBBB^^^^HHHr 

Massachusetts 

New York ^^^MHHBBBBBHBI^^^^^m 10 


0 10 20 30 40 50 60 70 80 90 100 


■ % Reported proficient or above by state test ■ % Reported proficient or above by NAEP 
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Appendix: Additional 201 3-1 4 Comparison Charts and all 201 2-1 3 
State Proficiency Rate Comparison Charts 
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Proficient vs. Prepared 

4th Grade Math, 2013-14 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Differential 

Louisiana -50 

Georgia -43 

Misa’ssippi -40 

South Carolina -40 

Alaska ^ MM— 1 -37 

Arkansas -37 

Nevada ^ -36 

Maryland ^ ^ ^ ™ 

Virginia ^ “ ™“ “ “ -33 

Nebraska -32 

Delaware -32 

Pennsylvania ■■■■■BHMHBBBBBBBB -32 

Iowa 1 1 -31 

Distria of Columbia -31 

North Dakota ^ ^ -31 

Indiana -31 

Texas 

Ohio ' -30 

Oklahoma -30 

New Jersey ■BBBBBBBBBBBBBBBBBBBBBB1^^^^M^^^^^“^^^“^^^^^^^“ -26 

Illinois 

Oregon 1 ' -24 

Florida 

Colorado -22 

Arizona ■* 

Rhode Island ^ -21 

^ 1 

Maine 

Alabama ^ 

New Hampshire I^^^^HI^^^^MI^^^^HH^^^HBiHHBHBBBBBHr"^^^^^ - ^ - 

Washington 

New Mexico -12 

Minnesota 

North Carolina -9 

West Virginia 

Kentucky MBBBBBBBMBBHBBBBBBBBBB^^^^^ 1 

Tennessee 

Michigan 

Wisconsin Bi^^^BI^^B^HBi^B^BM^BMBB^^B^^""^ 

Missouri -4 

Utah -4 

New York 
Wyoming 
Massachusetts 


0 10 20 30 40 50 60 70 80 90 100 


■ % Reported proficient or above by state test ■ % Reported proficient or above by NAEP 
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Proficient vs. Prepared 

8th Grade Reading, 2013-14 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 

Differential 

Georgia 
Texas 
Alaska 
Ohio 
Arkansas 
Hawaii 
Oklahoma 
Arizona 
Louisiana 
Nebraska 
Indiana 
Michigan 
North Dakota 
Iowa 
Rhode Island 
South Carolina 
Delaware 
Pennsylvania 
New Mexico 
Mississippi 
District of Columbia 
Maryland 
New Hampshire 
New Jersey 
Virginia 
Maine 
Massachusetts 
Washington 
Oregon 
Colorado 
Florida 
Alabama 
West Virginia 
Nevada 
North Carolina 
Wyoming 
Illinois 
Minnesota 
Missouri 
Kentucky 
Tennessee 
Utah 
New York 
Wisconsin 

0 10 20 30 40 50 60 70 80 90 100 

■ % Reported proficient or above by state test ■ % Reported proficient or above by NAEP 


*-65 

-59 

-53 

-48 

-47 

-44 

-43 

-42 

-42 

-41 

-41 

-40 

-40 

-38 

-38 

-38 

-38 

-37 

-37 

-37 

-37 

-35 

-34 

-34 

-34 

-33 

-31 

-30 

-29 

-26 

-24 

-23 

-23 

-23 

-21 

-20 

-20 

-15 

-15 

-14 


1 

2 
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Georgia 
Idaho 
Alabama 
Louisiana 
Arkansas 
South Carolina 
Ohio 
Arizona 
Alaska 
Montana 
Kansas 
Indiana 
Texas 
Nevada 
South Dakota 
Maryland 
Hawaii 
Nebraska 
Wyoming 
Utah 
Oregon 
Oklahoma 
Mississippi 
California 
Michigan 
Iowa 
Delaware 
North Dakota 
Connecticut 
Washington 
New Hampshire 
Maine 
Rhode Island 
District of Columbia 
Vermont 
Virginia 
Colorado 
Pennsylvania 
New Mexico 
Illinois 
Florida 
West Virginia 
Missouri 
New Jersey 
Tennessee 
Minnesota 
Kentucky 
North Carolina 
Massachusetts 
Wisconsin 
New York 


Proficient vs. Prepared 

4th Grade Reading, 2012-13 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Differential 
-59 



10 


20 


30 


40 


50 


60 


70 


80 


90 


i % Reported proficient or above by state test 


i % Reported proficient or above by NAEP 


100 
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Alabama 
Idaho 
South Carolina 
Louisiana 
Georgia 
Mississippi 
Arkansas 
Maryland 
Nevada 
Connecticut 
California 
Alaska 
Oklahoma 
Utah 
Kansas 
Wyoming 
South Dakota 
Pennsylvania 
North Dakota 
Indiana 
Delaware 
Ohio 
Iowa 

District of Columbia 
New Jersey 
Texas 
Nebraska 
Virginia 
Arizona 
Oregon 
Rhode Island 
Montana 
Colorado 
Illinois 
Florida 
Hawaii 
New Hampshire 
Maine 
Vermont 
Washington 
New Mexico 
West Virginia 
Missouri 
Minnesota 
Tennessee 
Michigan 
North Carolina 
Kentucky 
Wisconsin 
New York 
Massachusetts 

0 10 20 30 40 50 60 70 80 90 100 

■ % Reported proficient or above by state test ■ % Reported proficient or above by NAEP 
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Proficient vs. Prepared 

4th Grade Math, 2012-13 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Differential 



-52 


-46 



-45 



-45 



-45 



-43 


-43 


. _ 



-42 



-40 









-39 



-38 









-35 



-34 






-JJ 



-33 



-33 









-32 



-32 






oU 



-30 



-30 



-29 



-28 



-28 



-27 



-25 



-24 



-23 



-22 



-22 



-21 



-20 



-19 



-18 



-18 



-16 






-15 




-14 




-13 



-12 



-12 














_q 








-4 
















-2 
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Georgia 
Idaho 
Alabama 
Texas 
Alaska 
Utah 
Kansas 
Oklahoma 
Ohio 
Arkansas 
Louisiana 
Hawaii 
Arizona 
Montana 
Nebraska 
Rhode Island 
Connecticut 
Indiana 
North Dakota 
Delaware 
Maryland 
Wyoming 
New Hampshire 
District of Columbia 
New Mexico 
Maine 
South Carolina 
South Dakota 
New Jersey 
Vermont 
Pennsylvania 
Mississippi 
Virginia 
Michigan 
Oregon 
Massachusetts 
Iowa 
California 
Colorado 
West Virginia 
Washington 
Illinois 
Florida 
Nevada 
Missouri 
Kentucky 
Tennessee 
Minnesota 
North Carolina 
Wisconsin 
New York 


Proficient vs. Prepared 

8th Grade Reading, 2012-13 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Differential 
■-€5 
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I % Reported proficient or above by state test 


I % Reported proficient or above by NAEP 


100 
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Proficient vs. Prepared 


8th Grade Math, 2012-13 

Disparity in data reported by states and the 2013 
National Assessment of Educational Progress (NAEP) 


Alabama 
Georgia 
Mississippi 
Connecticut 
District of Columbia 
Louisiana 
Idaho 
Indiana 
Oklahoma 
South Carolina 
Delaware 
Texas 
Utah 
Arkansas 
Iowa 
Ohio 
Kansas 
South Dakota 
Alaska 
Pennsylvania 
North Dakota 
Nebraska 
Wyoming 
Maryland 
Oregon 
Arizona 
Hawaii 
Montana 
Virginia 
Illinois 
Rhode Island 
Maine 
New Hampshire 
West Virginia 
Tennessee 
Florida 
New Jersey 
Missouri 
New Mexico 
California 
Vermont 
Kentucky 
Washington 
Nevada 
Minnesota 
Colorado 
Wisconsin 
Michigan 
Massachusetts 
North Carolina 
New York 


Differential 




-57 



-54 




-52 




-49 




-46 




.AC 




-44 





-43 




-42 



-39 

-38 

-38 

-38 

-37 

-37 

-37 

-37 

-36 

-33 

-32 

-31 
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-30 
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-27 

-27 

-23 

-23 

-23 

-22 
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-21 

-20 

-20 

-20 

-20 

-19 

-19 

-17 

-17 

-15 

-11 

-11 

-10 

-9 

-5 

-5 
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■ % Reported proficient or above by state test ■ % Reported proficient or above by NAEP 
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NOTES 

California, Connecticut, Idaho, Montana, South Dakota, and Vermont were not included in the 
201 3-1 4 comparisons because those states piloted the Smarter Balanced assessment and did not 
report state-level proficiencies that year. 

Kansas' state proficiency data for 2013-14 is unavailable because the state's assessment vendor 
reported that the assessment delivery platform had been the target of a Distributed Denial of 
Service attack, which attempted to shut down the servers and severely impacted the testing 
environment for many students. Because impact of this attack resulted in the vendor's inability to 
verify the validity of the results for all students, the Kansas State Board of Education, with approval 
from the United States Department of Education, voted to not release any results of the 2014 state 
assessment. 

California reports 8th grade math proficiency by course and not by grade. To reach the figure on 
the 8th grade math charts, Achieve combined the percentage of 8th graders in California reported 
proficient by course. 

All states that use the New England Common Assessment Program/NECAP (Maine, New 
Hampshire, and Rhode Island) along with Michigan's MEAP administer their tests in the fall. The 
scores reflected in the 201 2-1 3 charts for those states are from fall 2012 from 8th grade students in 
the 201 2-1 3 school year. 

The results reported for Texas in the tables are those percentages for 201 2-1 3 and 201 3-1 4 that 
are used for school accountability and available in the Texas Academic Performance Reports 
(TAPR) system. However, Texas is currently in the process of phasing in more rigorous cut scores. 
The"STAAR Statewide Summary Reports 201 3-1 4," available here, provide data against the new 
cut scores. As of now, the final recommended performance standards will be implemented in the 
2021-2022 school year. (Source) 
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